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IN THE CLAIMS 

Please amend claims 15-17 and 30-56 as follows: 
1-14 (Canceled) 

1 5. (Currently Amended) A comput e riz e d system for indexing raw data from at least 
one data source based on d e t e cting a semantic temporal event included in the raw data r e cord e d 
on a m e dia , said system comprising: 

a comput e rized k nowledge-based modeling xmit for generating multiple-layer models for 
identifying said semantic temporal even t r e cord e d on the m e dia ; 

a storage mechanism for storing said multiple-layer models; 

an comput e riz e d observation collection unit for extracting, from said raw data from the at 
least one data source, temporal observation s record e d on th e m e dia according to said multiple- 
layer models for th e s e mantic t e mporal e vent ; [[and]] 

a comput e riz e d temporal event detection unit for detecting one or more occurrences of 
the semantic temporal event based on said temporal observations and said multiple-layer models; 
and 

an indexing mechanism for generating an index for said raw data based on the semantic 
temporal events detected bv the temporal event detection unit . 

16. (Currently Amended) The comput e riz e d system according to claim 15, fiirther 
including comprising : 

[[an]] a computerized event characterization unit for characterizing said occurrences of 
the semantic temporal event, detected by said comput e riz e d temporal event detector, to produce 
a characterization for the occurrences of the semantic temporal event. 
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17. (Currently Amended) The comput e riz e d system according to claim 16, further 
including comprising : 

a storage mechanism for storing the characterization produced by said event 
characterization imit; 

an a comput e riz e d event prediction unit for performing temporal event prediction based 
on said characterization; 

an a comput e riz e d event model updating unit for modifying said multiple-layer models 
based on said characterization; and 

an a computerized event simulation unit for simulating parts of said semantic temporal 
event according to said characterization. 

18-29 (Canceled). 

30. (Currently Amended) The comput e rized system ef according to c laim 15, 
wherein the semantic temporal event includes a sports event. 

3 1 . (Currently Amended) The comput e rized system ef according to claim 30, 
wherein said sports event includes a soccer game. 

32. (Currently Amended) The comput e riz e d system ef according to claim 15, 
wherein said multiple-layer models include a high level domain-specific knowledge model and a 
dynamic hierarchical event model. 

33. (Currently Amended) The comput e riz e d system ef according to claim 32, 
wherein said high level domain-specific knowledge model includes rules of a sports game. 

34. (Currently Amended) The comput e riz e d system ef according to claim 32, 
wherein said dynamic hierarchical event model includes a hierarchical decision tree. 

3 

20565155vl 



PATENT 
81674-306504 

35 . (Currently Amended) The oomputeriz e d system ef according to claim 32, 
wherein said dynamic hierarchical event model includes an entity-relationship-diagram. 

36. (Currently Amended) The oomput e riz e d system ef according to claim 1 5, 
wherein said at least one data source includes at least one data acquisition device including a 
camera, a microwave sensor, a sound recorder, and an input data stream selected from the group 
consisting of video, audio, text, and temporal features. 

37. (Currently Amended) The comput e riz e d system ef according to claim 36, 
wherein said temporal features include tracking position data. 

38. (Currently Amended) The oomput e riz e d system ef according to claim 15, 
wherein said at least one data source includes a data stream sent through a network coimection. 

39. (Currently Amended) The oomputeriz e d system ef according to claim 38 wherein 
the data stream is a video stream with synchronized audio track. 

40. (Currently Amended) The comput e riz e d system ef according to claim 15, 
wherein the oomput e riz e d observation collection unit is simultaneously connected to more than 
one data source. 

41 . (Currently Amended) The oomput e riz e d system ef according to claim 1 5, 
wherein said comput e rized t emporal event detection unit includes an integration unit, a detection 
unit, and a fusion unit, and said integration unit combines a plurality of observation streams from 
a plurality of data sources, the detection unit detects a same event using a plurality of detection 
means to produce a plurality of detection results, and said fusion unit fuses the plurality of 
detection results to produce a single detection decision. 
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42. (Currently Amended) The comput e riz e d system ef according to claim 16, further 
including comprising : 

an event storage, in which detected occurrences of temporal semantic events are stored; 

an events statistics extractor to compute statistical information about the detected 
occurrences; and 

an event statistics storage unit to store the statistical information. 

43 . (Currently Amended) A comput e riz e d system for indexing raw data from at least 
one data source based on d e t e cting a semantic temporal event included in the raw data r e cord e d 
on a m e dia , said system comprising: 

a comput e riz e d k nowledge-based modeling unit for generating multiple-layer models for 
said semantic temporal event; 

a storage mechanism for storing said multiple-layer models; 

an comput e rized observation collection unit for extracting, from said raw data from said 
at least one data source, temporal observations according to said multiple-layer models for the 
semantic temporal event; 

a comput e rized t emporal event detection unit for detecting one or more occurrences of 
the semantic temporal event included in the raw data r e cord e d on the m e dia b ased on said 
temporal observations and said multiple-layer models; 

mi a comput e riz e d event characterization unit for characterizing said occurrences of the 
semantic temporal event, detected by said comput e riz e d t emporal event detector, to produce a 
characterization for the occurrences of the semantic temporal event; 
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a storage mechanism for storing the characterization produced by said event 
characterization unit; 

an a comput e riz e d event prediction unit for performing temporal event prediction based 
on said characterization; 

an a comput e rized event model updating unit for modifying said multiple-layer models 
based on said characterization; [[and]] 

an event simulation imit for simulating parts of said semantic temporal event according to 
said characterizatio n: and 

an indexing mechanism for generating an index for said raw data based on at least one of 
the semantic temporal events detected bv the temporal event detection unit and the 
characterization for the occurrences of the semantic temporal event . 

44. (Currently Amended) The comput e rized system ef according to claim 43, 
wherein the semantic event includes a sports event. 

45. (Currently Amended) The comput e riz e d system ef according to claim 44, 
wherein said sports event includes a soccer game. 

46. (Currently Amended) The comput e riz e d system ef according to claim 43, 
wherein said multiple-layer models include a high level domain-specific knowledge model and a 
dynamic hierarchical event model. 

47. (Currently Amended) The comput e riz e d system ef according to claim 46, 
wherein said high level domain-specific knowledge model includes rules of a sports game. 

48. (Currently Amended) The comput e riz e d system ef according to claim 46, 
wherein said dynamic hierarchical event model includes a hierarchical decision tree. 
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49. (Currently Amended) The oomputorizod system ef according to claim 46, 
wherein said dynamic hierarchical event model includes an entity-relationship-diagram. 

50. (Currently Amended) The comput e riz e d system ef according to claim 43, 
wherein said at least one data source includes at least one data acquisition device including a 
camera, a microwave sensor, a sound recorder, and an input data stream selected from the group 
consisting of video, audio, text, and temporal features. 

5 1 . (Currently Amended) The comput e riz e d system ef according to claim 50, 
wherein said temporal features include tracking position data. 

52. (Currently Amended) The comput e rized svstem ef according to claim 43. 
wherein said at least one data source includes a data stream sent through a network connection. 

53. (Currently Amended) The comput e rized system ef according to claim 52, 
wherein the data stream is a video stream with synchronized audio track. 

54. (Currently Amended) The computerized system ef according to claim 43, 
wherein the computeriz e d o bservation collection xmit is simultaneously connected to more than 
one data source. 

55. (Currently Amended) The comput e riz e d system ef according to claim 43, 
wherein said computeriz e d t emporal event detection unit includes an integration unit, a detection 
unit, and a fusion unit, and said integration unit combines a plurality of observation streams from 
a plurality of data sources, the detection unit detects a same event using a pluraUty of detection 
means to produce a plurality of detection results, and said fiision unit fiises the pluraUty of 
detection results to produce a single detection decision. 
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56. (Currently Amended) The comput e riz e d system ef according to claim 43, fiirther 
comprising: 

an event storage, in which detected occurrences of temporal semantic events are stored; 

an events statistics extractor to compute statistical information about the detected 
occurrences; and 

an event statistics storage unit to store the statistical information. 
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